Papers with concept-irrelevant representations
CURE: Controlled Unlearning for Robust Embeddings — Mitigating Conceptual Shortcuts in Pre-Trained Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models are susceptible to spurious, concept-driven correlations that impair robustness and fairness. |
| Approach: | They propose a framework that disentangles and suppresses conceptual shortcuts while preserving essential content information. |
| Outcome: | The proposed framework improves on IMDB and Yelp datasets with minimal computational overhead. |